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Abstract —Accurate fading characterization and channel ca¬ 
pacity determination are of paramount importance in both 
conventional and emerging communication systems. The present 
work addresses the nonlinearity of the propagation medium 
and its effects on the channel capacity. Such fading conditions 
are first characterized using information theoretic measures, 
namely, Shannon entropy, cross entropy and relative entropy. The 
corresponding effects on the channel capacity with and without 
power adaptation are then analyzed. Closed-form expressions are 
derived and validated through computer simulations. It is shown 
that the effects of nonlinearities are significantly larger than those 
of fading parameters such as the scattered-wave power ratio, and 
the correlation coefficient between the in-phase and quadrature 
components in each cluster of multipath components. 

Index Terms —Adaptation policies, channel capacity, entropy. 


I. Introduction 

M ULTIPATH fading characterization is considered a crit¬ 
ical task in the effective analysis of the performance 
of wireless communication systems. To this end, the a — fj>, 
r) — /x, A — /x and n — /i distributions have been considered 
relatively suitable models as they also include as special cases 
the widely known Rayleigh, Nakagami— m, Hoyt, Weibull and 
Rice distributions, see Q-GD and the references therein. 

It is also known that accurate determination of the channel 
capacity for different communication scenarios has been of 
core importance in wireless communications, including re¬ 
quirements on optimum rate and transmit power constraints. 
To this end, the average channel capacity over generalized 
fading channels was thoroughly analyzed in 11 , whereas 
the channel capacity under different adaptation policies was 
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thoroughly investigated in l22l - l24j . 

Nevertheless, in spite of the usefulness of the aforemen¬ 
tioned distributions, their accuracy and generality are limited, 
since the non-linearity parameter a in these models is not 
related to the fading parameters 77 , A and n |25l . As a 
consequence, the detrimental effects of non-linear propagation 
medium are not considered in the majority of investigations. 
Motivated by this, the authors in l25l proposed the a — rj — fi 
and a — K—ft distributions which constitute a generalization of 
the a — ft,, ri — // and k — /x models and were shown to provide 
remarkably accurate fitting to measurement results in various 
communication scenarios. In this context, useful statistical 
results and properties for the a — X — fi and a — rj - // models 
were reported in I26l - l28l whereas the corresponding outage 
probability was analyzed in f29l . A simple and remarkably 
accurate random sequence generator for a— re—/x and a—r /—/x 
variates was proposed in |30] while the corresponding symbol 
error rate and channel capacity was addressed in (3ll . If32l . 

However, none of the reported analyses address the cor¬ 
responding channel capacity with optimum power and rate 
adaptation. Motivated by this, the aim of the present work 
is twofold: we firstly derive novel analytic expressions for the 
Shannon entropy of a — t] — /x and a A — /x distributions. 
Capitalizing on this, we derive analytic expressions for the 
cross-entropy and relative entropy for these distributions with 
respect to the 77 — /x and A — /x distributions, respectively. 
Secondly, we derive novel closed-form expressions for the 
corresponding channel capacity under optimum rate adap¬ 
tation as well as optimum power and rate adaptation. The 
derived expressions are subsequently used in evaluating the 
corresponding performance, which indicates that the effects 
of fading non-linearities are larger than those of popular and 
widely considered fading parameters. 

II. Non-Linear Fading Channels and Entropies 
A. The a — rj — fj, and a — X — /x Models 

The SNR PDF of the a — 77 — /x distribution is given by |25l 
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where a denotes the non-linearity of the propagation medium, 
// is the scattered wave power ratio between the in-phase and 
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quadrature components and p is related to the number of 
multipath clusters. Likewise, the SNR PDF of the a — A — p 
fading model is expressed as follows: 
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where A denotes the correlation coefficient between the in- 
phase and quadrature components of the fading signal |26| . 
It is recalled that the a — p — p and a A — p distributions 
include as special cases the a — p, the p — p and the A — /i 
fading models for a = 2, p = 2 and A = 0, respectively ll25l . 

B. Shannon Entropy 

The Shannon entropy is a fundamental metric which denotes 
the amount of information contained in a signal and indicates 
the number of bits required for encoding this signal. 

Lemma 1. For {ct, 77 , 7 , 7 } G R + an d /x = 1, the Shannon 
entropy of the a — p — p fading distribution is expressed as 
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Ci = (1 + p) 2 /{2p^) and T>\ = (p 2 — l)/(2p'y^) with 
y' = 0.5772 denoting the Euler-Mascheroni constant. 

Proof: The Shannon entropy for continuous ran¬ 
dom variables with PDF p(x) is given by H(p) = 
— / 0 °° p(x) log 2 (p{x)) dx. Thus, for the case of a — p — p 
fading in © and with the aid of standard logarithmic identities 
it follows that 
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The first two integrals in © can be expressed in closed-form 
with the aid of f33l eq. (4.352.1)] and ll33l eq. (8.310.1)] and 
involve the digamma function, ^(1). By also noticing that 
exp(— x) in the logarithm of © becomes practically negligible 
as x » 0 , recalling that L ( 1 ) = — 7 ' and after some algebraic 
manipulations, one obtains ©, which completes the proof. ■ 

Importantly, the Shannon entropy can quantify the detri¬ 
mental effects of fading non-linearity by determining the 
variation of required bits per message for each value of a. This 
demonstrates the difference between the a—p—p and a—X—p 
distributions with the popular p — p and A — p distributions, 
respectively, which is also reflected by the considered channel 
capacity measures. This is subsequently analyzed along with 
the derivation of useful analytic expressions for the corre¬ 
sponding cross entropy and relative entropy metrics. 

C. Cross Entropy 

The cross entropy measures the average number of bits 
required to encode a message when a distribution p(x) is 
replaced by a distribution q(x). In the present analysis this 
can exhibit the number of bits required to encode a — p — p 
and a — X — p when they are replaced by 77 — p and 
A — p distributions, respectively, which corresponds to the case 
where the non-linearity parameter is not taken into account. 

Lemma 2. For {a, p 1 77 ', 7 , 7 , 7 '} £ R + and p = 1, the cross 
entropy between a — p — p and p — p distributions is given by 
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Proof: The cross entropy between two continuous dis¬ 
tributions with PDFs p(x) and q(x) is given by H(p,q) = 
- f 0 °° p(x) log 2 (g(a;))da;. Therefore, for the case of a — p — p 
and 77 — p distributions, respectively, it follows that 
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where B 2 _= vV + Wv' ~ /iVd'\fl’) L _C 2 = (1 + 

p') 2 /(2p'Y) and T> 2 = (p 1 + 1 ) (77 — l)/{2p'j r ) correspond 
to the parameters of 77 — p distribution. It is evident that the 
algebraic representation of © is similar to ©. Based on this, 
the proof follows immediately using Lemma 1. ■ 

In the next Section, it is shown that the value of the 
considered H(p. q) varies substantially at even slight variations 
of a. It is also shown that this variation is larger than that from 
widely used fading parameters such as p and A. This justifies 
the usefulness of the a — p — p and a — X — p distributions. 
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D. Relative Entropy 

The relative entropy, which is also known as the Kullback- 
Leibler divergence, is a measure of the distance between two 
probability distributions. It accounts for the inefficiency of 
assuming that a true distribution with PDF p(x ) is replaced 
by a distribution with PDF q(x). In the present analysis, this 
measure quantifies the information loss encountered when the 
non-linearity parameter is not taken into account, which occurs 
when a — r) — p and a — A — p distributions are replaced by 
the simpler rj — p and A — p distributions, respectively. 

Lemma 3. For {a, t), p', 7,7,7'} £ R + , p = 1, the relative 
entropy between a — p — p and p — p models is expressed as 

D(p\\q) = H(p,q) - H(p) (9) 

where H(jp, q) and H(jp ) are given in (0 and 0, respectively. 

Proof: By recalling that the relative entropy is defined as 

D(p\\q) = J p{x) log 2 & x ( 10 ) 

the proof follows with the aid of Lemma 1 and Lemma 2. ■ 
Notably, similar expressions for the Shannon entropy of ct — 
A — p distribution as well as the cross entropy and relative 
entropy between a—X — p and A — p distributions are obtained 
by setting p = (1 — A)/(l + A) in 0, 0 and 0. respectively. 
Extensive results for all considered entropies for both a—p—p 
and a — X — p fading conditions are provided in Section IV, 
indicating the non-negligible effects of fading non-linearity. 

III. Capacity Under Different Adaptation Policies 
A. Capacity with Optimum Rate Adaptation 

The Shannon capacity of a channel constitutes a theoretical 
upper bound for the maximum rate of data transmission and 
is also used as a benchmark for comparisons of the channel 
capacity under different adaptation schemes 12. In what 
follows, we derive a closed-form expression for the average 
Shannon capacity over a — p — p fading channels. 


With the aid of ||33l eq. (8.467)], it follows that 
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Importantly, the exponential and logarithmic terms in (IT4l i can 
be expressed in terms of the Meijer G-function in 1341 yielding 
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The above integral can be expressed in closed-form in terms of 
l34l eq. (21)]. To this effect and after long but basic algebraic 
manipulations, one obtains CD. This concludes the proof. ■ 
Equation (fill is expressed in closed-form and can be com¬ 
puted in software packages such as Maple and Mathematica. 


B. Capacity with Optimum Power and Rate Adaptation 

Wireless systems are often subject to average transmit power 
constraints. Based on this, the maximum capacity for optimum 
power and rate adaptation. Copra, can be determined 12 . 

Theorem 2. For {a, p, 7, 7 o, B} £ R + and p £ N, the 
channel capacity over a —p — p fading channels with optimum 
power and rate adaptation is expressed as follows: 
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Theorem 1. For {a,p,J,B} £ R + and p £ N, the average 
channel capacity over a — p — p fading channels with optimum 
rate adaptation is expressed as follows: 
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where B is the corresponding bandwidth, G(-) is the Meijer 
G—function and A(x, y ) = y/x, (y+l)/x ,..., (y + x — l)/x. 

Proof: Recalling the definition of the average ergodic 
capacity 

/»00 
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where 70 is the SNR threshold that determines transmission. 

Proof: By firstly recalling the following generic expres¬ 
sion 

Copra = B log 2 (fPj p 7 ( 7 )d 7 (17) 

as well as substituting 0 and expanding the logarithm using 
l33l eq. 8.467], one obtains (IT2 (top of the next page). 
Notably, the two integrals that emerge from the second term 
of the numerator of ( IT8] > can be expressed in terms of 133] eq. 
(8.310.1)] which yields 
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Integrating by parts the two remaining integrals and applying 
031 eq. (4.352.1)], the resulting integrals can be evaluated 
using ll33l eq. (8.310.1)]. Based on this and after long but basic 
algebraic manipulations yields (fl6l >. completing the proof. ■ 
It is noted that closed-form expressions for CorA^ anc * 
^OPRA^ can be readily deduced by setting 77 = (1 —A)/(l+A) 
in O and Also, the corresponding channel capacities 
for 77 — /u, and A — p fading channels are deduced for a = 2. 



Fig. 1. Copra vs 7 over a — 77 — /i and a — X — fi fading channels for 
77 = 0.6, A = 0.25, [i = 2 and different values of the fading non-linearity a. 


IV. Numerical Results 

The offered results are employed in quantifying the effects 
of the non-linearity of the propagation medium. To this end. 
Table I depicts the H(p), H(p : q) and D(p\\q) measures for 
different values of the fading parameters at 7 = 15dB. It 
is shown that the Shannon entropy is inversely proportional 
to the a parameter which indicates that the more severe the 
incurred non-linearity, the more bits are required to encode 
the corresponding message. To this effect, it is shown that an 
extra bit is required for encoding the message correctly when 
a = 1, with r) = 2, A = 1/2 and p = 1, compared to the 
similar case with a = 3. On the contrary, it is observed that 
the lowest value of cross entropy in both cases is for a = 2, 
i.e., when a — p — p and a — X — p reduce to 77 — p and A — p, 
respectively. From this point, the value of H (p, q) increases as 
the value of a both increases or decreases. For example, while 
7 bits/message are practically required when a = 2, this value 
increases to 10 bits/message and 14 bits/message for a = 1/2 


TABLE I 

Entropies of q — q — p and a — A - p distributions for 7 = 15 dB 



H(p) 

H(p,q) 

D(p||q) 

a-X-fi 

H(p) 

H(p,q) 

D(p||q) 

x-2-1 

7.03 

9.69 

2.66 

H-i 

6.94 

9.42 

2.48 

1 - 2-1 

6.87 

8.37 

1.50 

1 -I - 1 

6.86 

8.21 

1.36 

1 - 2-1 

6.56 

6.91 

0.36 

s4-i 

6.57 

6.87 

0.30 

2 - 2-1 

6.28 

6.28 

0.00 

H- 1 

6.31 

6.31 

0.00 

§- 2-1 

6.05 

7.63 

1.59 

f-f 1 

6.08 

7.52 

1.44 

3 - 2-1 

5.83 

13.3 

7.45 

3-1-1 

5.88 

12.5 

6.62 


TABLE II 

Cora FOR Ct — q — p AND a — A — p DISTRIBUTIONS 


OL-r]-[i / 7 (dB) 

°ORA 

a-X-fi / 7 (dB) 

Co^/B 

1-1-1 / -5dB 

0.458 

1-0.1-1 / -5dB 

0.358 

1-1-1 / 15dB 

4.432 

1-0.1-1 / 15dB 

4.428 

1-1-1 / 35dB 

10.85 

1-0.1-1 / 35dB 

10.85 

2-1-1 / -5dB 

0.529 

2-0.1-1 / -5dB 

0.378 

2-1-1 / 15dB 

4.685 

2-0.1-1 / 15dB 

4.674 

2-1-1 / 35dB 

11.25 

2-0.1-1 / 35dB 

11.24 

2-2-2 / -5dB 

0.385 

2-0.5-2 / -5dB 

0.384 

2-2-2 / 15dB 

4.839 

2-0.5-2 / 15dB 

4.819 

2-2-2 / 35dB 

11.42 

2-0.5-2 / 35dB 

11.40 

3-2-2 / -5dB 

0.398 

3-0.5-2 / -5dB 

0.380 

3-2-2 / 15dB 

4.900 

3-0.5-2 / 15dB 

4.886 

3-2-2 / 35dB 

11.49 

3-0.5-2 / 35dB 

11.48 

3-3-3 / -5dB 

0.399 

3-0.9-3 / -5dB 

0.380 

3-3-3 / 15dB 

4.933 

3-0.9-3 / 15dB 

4.888 

3-3-3 / 35dB 

11.53 

3-0.9-3 / 35dB 

11.48 


and a = 3, respectively. Finally, the relative entropy measure 
demonstrates the information lost when a is not considered. 
It is evident that D(p\\q) = 0 when a = 2 and increases as a 
decreases and particularly when it increases. 

The effect of fading non-linearity on Cora and Copra is 
demonstrated in Table II and Fig. 1, respectively. It is shown 
that the corresponding spectral efficiency is, as expected, 
proportional to the value of a in both a — rj — p and a — A — p 
fading conditions. Interestingly, it is shown that the effect 
of a is more significant than the overall effect of 77 and A 
parameters together with p. This illustrates the importance of 
considering the effects of fading non-linearity in the design 
and performance analysis of wireless communication systems. 

V. Conclusion 

This work quantified the effects of non-linearity, a, of 
the propagation medium in wireless transmission by means 
of the Shannon entropy, cross entropy and relative entropy 
measures. The average channel capacity over generalized non¬ 
linear fading conditions was also evaluated for the cases of 
optimum rate and optimum power and rate adaptations. It was 
shown that the effects of a are more pronounced than those of 
the commonly used fading parameters rj, A and p combined. 
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